Transforming Excavator to Transformer